
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark OfTice 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 2231 3- MSO 
www.usptO.gov 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. 



CONFIRMATION NO. 



09/666,283 



09/21/2000 



7590 06/21/2004 

FLESHNER&KIM, LLP 

14500 AVION PARKWAY, SUITE 125 

CHANTILLY, VA 20151 



Sung Bae Jun 



CIT/K-130 



8473 



EXAMINER 



BUL KIEU OANH T 



ART UNIT 



PAPER NUMBER 



2611 

DATE MAILED: 06/21/2004 



Please find below and/or attached an Office communication concerning this appUcation or proceeding. 



PTO-90C (Rev. 10/03) 



w 


Application No. 


Applicant(s) 




Office Action Summary 


09/666,283 


JUN ET AL 




Examinor 
KIEU-OANH TBUI 


Art Unit 

2611 





The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )□ Responsive to connnnunication(s) filed on . 

2a)n This action is FINAL. 2b)K This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Clalm(s) 1-22 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) ^ Claim{s) is/are rejected. 

Claim(s) is/are objected to. 

8) \3 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)n The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing{s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner, Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)IEI All b)n Some * c)\J None of: 

1 .[3 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) IS NoUce of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) n Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/MaiI Date. . 

3) 13 Infomnation Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Infonnal Patent Application (PTO-152) 

Paper No(s)/Mail Date 4&8, 6) □ Other: . 



U.S. Patent and Trademartc Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mail Date 9 





Application/Control Number: 09/666.283 
Art Unit: 2611 



Page 2 



DETAILED ACTION 



Claim Rejections - 35 USC 102 



1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless — 

(b) the invention was patented or described in a printed publication in this or a foreign 
country or in public use or on sale in this country, more than one year prior to the date of 
application for patent in the United States. 

2. Claims 1-22 are rejected under 35 U.S.C. 102(b) as being anticipated by Hoffert et al. 
(U.S. Patent No. 5,903,892/ or "Hoffert" hereinafter). 

Regarding claim 1, Hoffert discloses "a method of constructing information on associate 
meanings between segments of a multimedia stream", i.e., indexing is used as a method of 
constructing information for video and audio segments with their associate meanings of a 
multimedia stream (col. 6/line 41 to col. 7/line 26, and fixrther on col. 14/lines 30-62 for audio 
segments and col. 21/lines 55-65 for video segments), "characterized by describing information 
on associate meanings between segments including the information between a segment locator 
and information on description of relationship between located segments in a data region based 
on contents of a multimedia stream so as to construct information on said stream", i.e., a media 
index is creating based on predetermined or associate meanings between segments using the 
contents of the multimedia stream for the constructing information occurred (see Figs. 2B & 2C, 
and col. 6/lines 20-55 & col. 7/line 1 1 for the contents of video and audio based on content 
attributes of media objects and associate relevant data). 
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As for claims 2 and 13, in further view of claim 1, Hoffert discloses "wherein the 
information on associate meanings between segments is an information on cause/effect or 
abstract/detail relationship", i.e., a plurality of attributes on cause/effect or on abstract/detail 
between related segments as relevant lexical content information related to media file for the user 
to have a meaningful database to search (col. 5/lines 1-29 & col. 6/lines 20-46 & col. 7/line 52 to 
col. 8/line 8). 

As for claim 3, in view of claim 1, Hoffert further discloses "wherein the segment locator 
of information on associate meanings comprises a segment locator of original text and an object 
segment locator, the information on description of the relationship describing associate meanings 
between the segment of original text and the object segment", i.e., original text and an object 
segment locator is performed based on their related relationship of information (Figs. 2B & 2c, 
and col. 3/lines 19-28 for an overview of the creating the relationship as noted; and col. 8/line 12 
to col. 9/line 13 for another explanation on examples of building or constructing segments with 
their associated information in the plainly English language). 

As for claim 4, in further view of claim 1, Hoffert further discloses "wherein the segment 
locator is an information intervals" (as shown in Figs. 3E & 3H, information intervals are used as 
segment locators; and tags for video segments are regarding as information intervals for 
predetermined video segments, see more on col. 21/lines 61-65, col. 22/line 62 -col. 23/line 17). 

As for claim 5, in further view of claim 4, Hoffert discloses "wherein the segment locator 
further comprises information on a stream" (col. 6/lines 20-55 for information is stored on a 
stream of segments or in a portion of the media file). 
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As for claims 6 and 7, in further view of claim 4, Hoffert discloses "wherein the 
information on intervals is described as a starting point and an ending point of the segments" and 
"wherein the information on intervals is described as information on a starting point and a length 
of the segments", i.e., length and time of the video segments is calculated for a number of frames 
or an information interval representing a starting frame and an ending frame from N=l to N 
(integer) frames in a predetermined timeframe T (col. 20/line 44-col. 21/line 28). 

As for claim 8, in further view of claim 5, Hoffert suggests "wherein the information on a 
stream is an information on relative/absolute locations of the stream" (col. 20/line 44-col. 21/line 
28 since the locations of frames is determined by a formula with number of frames in N>=0 or 
integer numbers, for instance, the user can select a segment from Frame 15 to Frame 80; 
therefore, the information on relative/absolute locations of the stream can be determined). 

As for claim 9, in fiirther view of claim 5, Hoffert discloses "wherein the information on 
a stream comprises a unique identifier (ID) for the stream" (col. 6/line 56-col. 7/line 25 as the 
indexing technique of video and audio files for identifying or locating segments or portions of 
audio/video files; and col. 25/lines 39-61 for media track IDs). 

As for claim 10, in further view of claim 5, Hoffert further discloses "wherein the 
information on a stream may be omitted from the segment of original text by setting the 
information based on the stream, to which the segment of original text belongs" (Fig. 4E, step 
445 to step 446 as a good example for irrelevant information can be omitted as a criteria is set, 
and if frames or streams do not meet the predetermined criteria, frames can not be selected in the 
next step at step 447). 
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As for claim 1 1, in further view of claim 1, Hoffert discloses further "comprising 
information on an additional weight value with respect to the cause/effect relationship between 
the segments so as to order the segments affecting a particular segment or the segments affected 
by a particular segment" (col. 7/lines 27-51 for additional weight values addressed). 

Regarding claim 12, Hoffert discloses "a method of browsing a video using information 
on associate meanings between segments of a multimedia stream characterized by a video 
browsing interface including a video display view and a key frame or a key region view, the 
method comprising the steps of displaying the information on associate meanings between 
segments by the video browsing interface further including key frames or key regions or text for 
displaying information on associate meanings between the segments; and performing a video 
browsing by using key frames or key regions or text displaying the information on associate 
meanings between segments", i.e., a media index is creating based on predetermined or associate 
meanings between segments using the contents of the multimedia stream for the constructing 
information occurred (see Figs. 2B & 2C, and col. 6/lines 20-55 & col. 7/line 1 1 for the contents 
of video and audio based on content attributes of media objects and associate relevant data), and 
Figs. 4A & 4B for performing a video browsing by using key frames or key regions or text 
displaying the information on associate meanings between segments). 

As for claim 14, in further view of claim 12, Hoffert discloses "wherein a user can select 
a case as to whether to shift to a frame corresponding to the selection region or to a segment 
represented by the selected region, or to a cause segment of the corresponding segment or to an 
effect segment or to an abstract segment or to a result segment, if the user selects a 
predetermined display region of the key frame or the key region view" (Figs. 4A & 4B for 
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performing a video browsing by using key frames or key regions or text displaying the 
information on associate meanings between segments on any segments selected by the user, see 
more details on col. 21/line 55 to col. 24/line 13). 

As for claims 15 and 17, in further view of claim 12, Hoffert further suggests "wherein 
each segment is expressed by a node, and the relationship between the segments is expressed by 
a link in a region displaying the information on associate meanings between segments" and 
"wherein the corresponding node and the link are displayed in a graphic structure in the region 
displaying the information on associate meanings between segments" (Fig. 3 A as attribute 
segments as nodes are linked together based on their relationship as a link in a graphic structure 
as stated). 

As for claim 16, in further view of claim 15, Hoffert shows "wherein each node is 
expressed by using the key frame, the key region or a text in the region displaying the 
information on associate meanings between segments" (Figs. 4A & 4B for performing a video 
browsing by using key frames or key regions or text displaying the information on associate 
meanings between segments on any segments selected by the user, see more details on col. 
21/line 55 to col. 24/line 13). 

As for claim 18, in further view of claim 15, Hoffert shows "wherein the corresponding 
node and the link are displayed in a tree structure in the region displaying the information on 
associate meanings between segments" (Fig. 3A as attribute segments as nodes are linked 
together based on their relationship as a link in a tree structure as stated). 
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As for claim 19, in further view of claim 15, Hoffert suggests "wherein the corresponding 
node and the link are displayed in other structures than the graphic structure or the tree structure 
in the region displaying the information on associate meanings between segments, the 
corresponding segment and the segments related to the associate meanings being dynamically 
converted and displayed when a predetermined segment is selected", i.e., URL structure, HTML 
structure, a Java script structure, or tables, or lists and other structures are used for representing 
the relationship of associate meanings between segments, see col. 4/lines 31 to col. 5/line 29). 

As for claims 20-22, in further view of claim 15, these claims for the steps of "wherein a 
shift is made to a corresponding segment if each node of a graphic view of information on 
associate meanings is selected"; "wherein the region displaying the information on associate 
meanings displays the region displaying the information on associate meanings between 
segments centering around a segment currently being displayed"; and "wherein the graphic view 
of information on associate meanings selects a plurality of nodes, and the segments 
corresponding to the more than one selected node are automatically linked and reproduced" are 
rejected for the reasons given in the scope of combined claims 12, 14-17 as discussed above. 

Conclusion 

3. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Hoffert et al (US Patent 6,370,543 B2), French et al. (US Patent 6,266,053 Bl), Rangan et al 
(US Patent 6,154,771), and Cheng et al (US Patent 6,731,314 blO disclose systems related to 
building or constructing information on associate meanings beUveen segments of multimedia 
files. 
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Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 
Washington, D.C. 20231 



or faxed to: 



(703) 872-9306, (for Technology Center 2600 only) 



5. Any inquiry concerning this commimication or earlier communications from the examiner 
should be directed to Krista Kieu-Oanh Bui whose telephone number is (703) 305-0095. The 
examiner can normally be reached on Monday-Friday from 9:00 AM to 6:30 PM, with alternate 
Fridays off. 

If attempts to reach the examiner by telephone are unsuccessfril, the examiner's 
supervisor, Andrew Faile, can be reached on (703) 305-4380. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to Technology Center 2600 Customer Service Office whose telephone number 
is (703) 306-0377. 




Krista Bui 
Art Unit 2611 
June 10, 2004 



KRISTA BUI 
ttSTErfr EXAMINER 



